Pervasive Network for Environmental Sensing

ABSTRACT

Data pertaining to environmental information is acquired using sensors on a multiplicity of networked pervasive devices, and analyzed to determine occurrence of at least one environmental event. Such data can be obtained, for example, from an inventive wireless communications device including an antenna, transmit circuitry coupled to the antenna for transmission of radio frequency radiation therefrom, at least one environmental sensor configured to obtain environmental data, and a communications module coupled to the at least one environmental sensor and configured to cause transmission of a representation of the data via the antenna and the transmit circuitry.

FIELD OF THE INVENTION

The present invention relates generally to the field of pervasivenetworks, and more particularly relates to the use of pervasive devicesfor mobile environmental sensing.

BACKGROUND OF THE INVENTION

The last few decades have seen an exponential increase in the worldwideuse of pervasive devices, such as mobile phones, personal digitalassistants (PDAs), game players, embedded processors, laptop computersand desktop computers. There continue to be great advances in bothtechnological capability and ubiquity which serve to facilitateincreasingly universal communications. Furthermore, these pervasivedevices increasingly have integrated capabilities beyond meretelecommunications or computing; for example, such devices nowadays arefrequently integrated with internal clocks, GPS systems, and image/videocapture systems.

Nonetheless, advances in early detection and notification ofenvironmental conditions have not kept pace with the overall advances incommunications technology. Indeed, there have been many well-documentedinstances of ineffective communication. Some of these have occurredduring disasters both natural (for example, the Asian Tsunami andHurricane Katrina) and man-made (for example, the September 11 terroristattacks) which resulted in literally thousands of deaths which couldlikely have been avoided had more timely information been provided bothto governmental authorities and to those within the zone of danger.Today's limited early detection systems (for example, seismographs orfire lookouts) are limited not only in density and coverage area, butalso lack the ability to collect and collate multiple stimuli in orderto obtain a more detailed picture of the surrounding environment.Furthermore, current warning systems tend to focus on advisoriescommunicated via mass media, which frequently are both overbroad(causing people to assume these advisories are irrelevant and thus maybe safely ignored) and underbroad (failing to reach the populations mostdirectly endangered who may not be actively monitoring the broadcastmedia, for example, beachgoers during the Asian Tsunami and officeworkers on September 11). Notification regarding non-disaster conditionsalso could benefit from improvement; for example, “macro” weatherreports used to predict whether it is a good day for the beach or forboating may not accurately reflect local conditions at a beach orboating region of interest.

It would thus be desirable to overcome the limitations in previousapproaches.

SUMMARY OF THE INVENTION

Principles of the present invention provide techniques for monitoringenvironmental conditions. In one aspect, an exemplary method includesthe steps of acquiring data pertaining to environmental informationusing a multiplicity of sensors on a multiplicity of networked pervasivedevices, and analyzing the data to determine occurrence of at least oneenvironmental event.

In another aspect, an exemplary networked pervasive device associatedwith a network includes at least one environmental sensor configured toobtain environmental data, and a communications module coupled to the atleast one environmental sensor and configured to cause transmission of arepresentation of the data via the network in a form for subsequent datamining within the network.

In yet another aspect, an exemplary method of providing a service formonitoring environmental conditions includes the steps of facilitatingoffering the monitoring service on a subscription basis, facilitatingreceiving subscriptions to the service from a plurality of subscriber's,facilitating acquisition of data pertaining to environmental informationusing at least one sensor on at least one networked pervasive device,facilitating analysis of the data to determine occurrence of at leastone environmental event, and facilitating notification of at least oneof the subscribers of the occurrence of the event.

One or more embodiments of the invention can be implemented in the formof a computer product including a computer usable medium with computerusable program code for performing the method steps indicated.Furthermore, one or more embodiments of the invention can be implementedin the from of an apparatus including a memory and at least oneprocessor that is coupled to the memory and operative to performexemplary method steps.

These and other features and advantages of the present invention willbecome apparent from the following detailed description of illustrativeembodiments thereof, which is to be read in connection with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an illustrative embodiment of one or more aspects of thepresent invention;

FIG. 2 shows an exemplary process flow for collecting and analyzing thedata in accordance with an aspect of the present invention;

FIG. 3 shows an exemplary pervasive device according to an aspect of theinvention;

FIG. 4 shows a mole specific example of an inventive pervasive computingdevice;

FIG. 5 shows an exemplary process flow for a service offering inaccordance with an aspect of the invention; and

FIG. 6 depicts a computer system that may be useful in implementing oneor more aspects and/or elements of the present invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

The present invention will be described herein in the context ofexemplary methods and apparatus for monitoring environmental conditions.It is to be understood, however, that the techniques of the presentinvention are not limited to the methods and apparatus shown anddescribed herein. Furthermore, as used herein, “environmental” datashould be broadly construed to cover any data that can be sensed andshould not be limited to hazard warnings or other specific examples thatmay be given.

FIG. 1 depicts an illustrative embodiment of one or more aspects of thepresent invention. Data from pervasive devices 102 (for example, mobilephones, PDAs, game systems, embedded processors, pocket computers,laptop computers and/or desktop computers) within a defined geographicregion 100 can be monitored, analyzed and synthesized (for example,locally or by a central sever 104) to generate real time detection andanalysis of events and features occurring in the environment. Thecentral server makes use of any preexisting data 105 that is relevant togenerate events. For example, the knowledge that thunderstorms are oftenfollowed by an increase in road accidents or the fact that highways K64,M-44 are prone to accidents will be used by the central server inaddition to the data provided in 110. This aspect enables the synthesisof data from multiple types of sensors at all geographic locations. Asecond aspect of the invention allows the notification of users 112 (forexample, via the pervasive computing devices) and/or emergency services108, within a region currently or potentially affected by an event,regarding current conditions and suggested responses. A third aspect ofthis invention is the use of these previously-disclosed aspects inservices offerings, for example, in the from of a business model tocapture, analyze, synthesize and report events and features tosubscribers, application developers or information brokers 114.

The sensors, which can be embedded into the pervasive computing devicesusing, for example, Micro-Electro-Mechanical Systems (MEMS) and/orSystem-on-package (SOP) technology, can include, by way of example andnot limitation, images, video streams, temperature, shock, barometricpressure, chemical detection, radioactivity, user biometrics, and thelike. Mobile devices can provide access to geographic locations notpopulated by fixed systems such as highways and outdoor areas, and canprovide access to tens of millions of geographic locations; essentially,any location where any person is.

A server can collect this information and creates a view of theenvironment in both space and time and further analyze the data (forexample, by using environmental event algorithm models 106 to determinewithin statistical certainty that an event is occurring in real time).The system can also combine and fuse data from multiple sensors,integrating information about time, location, temperature, sound, image,heat, infrared, and the like, to sense and understand higher-levelfeatures.

For example, on a macroscopic scale, an earthquake in California can bevisualized by recording the real time “shock” (accelerometer) sensors incomputer devices within a geographic area. On the microscopic scale,chemical sensors could be used to identify a gas leak in a particularlocation, while also detecting information from pressure sensors to findthe wind direction. The two variables can be integrated to predict thedirection of gas leakage and notify users, or to visualize the movementof the gas cloud over the environment. Combining information frommultiple sensor networks (“data fusion”) enables new applications. Suchapplications are not limited to disaster sensing and prediction. Forexample, sensors could be used to determine conditions for recreation,such as determining the local environment at, fox example, a beach.Macroscopic weather forecasts often do not provide sufficient detail todetermine if an individual would be comfortable at a beach along theocean. However, sensing from multiple pervasive devices could provideinformation on local wind direction, wind temperature, humidity, sunintensity at ground level, beach population density and watertemperature, which could be used by a machine implementing anintelligent algorithm to determine if conditions at a beach would meetan individual's comfort level. Weather information for sailing can begenerated using the pervasive devices of the number of people that arepresent at a beach or other region near where one might wish to gosailing. The individual wind and light sensors on the pervasive deviceof each tourist on the beach (or other region) gives us the winddirection at the location of that particular tourist. By fusing andanalyzing the data from the large number of such tourists on the beach,a map of the wind direction and the cloud formation on the sea shore canbe generated. This can be matched against the pre-existing informationof the ideal wind and/or light conditions for sailing near thatparticular beach (or other region). Thus, using the multitude of sensorson these devices, a score can be generated that provides informationabout how conducive the shore is for sailing. This information can berelayed to interested sailors who would not have to travel to the beach(or other region) and identify these conditions. Exemplary types ofsensors and their local and global uses are summarized in the tablebelow:

TABLE 1

Another exemplary application includes surveillance. For example, manypeople have cellular phones with image capture. A bag might be abandonedat an airport. Gas sensors might determine dangerous substances in thebag. Heat detectors might locate hidden criminals or terrorists whoplanted the bag. Data could be gathered passively (for example, gas,heat) or actively (for example, using cell phone cameras). In someembodiments, incentives could be provided for voluntary opt-in toaddress potential invasion-of-privacy concerns. Other types ofsurveillance could include a “worried patent” service that could trackthe location of a child and, for example, the presence of illegal drugsor alcohol, or excessive profanity (for example, via automatic speechrecognition). Such approaches could also be adapted to tracking elderlyparents, lost pets, and the like

FIG. 2 shows an exemplary process flow for collecting and analyzing thedata in accordance with an aspect of the present invention.

The data from one or more networked pervasive devices 1 . . . N arecollected in step 200 and then sent to a central data server in step202. This may operate using either a “push” mechanism (the devicesinitiates data transfer to the server) or a “pull” mechanism (the serverinitiates data transfer from the devices). In other embodiments, datamay be sent responsive to a user action. Monitoring can be continuous orintermittent. The server logs the time and location of the pervasivedevice and whether it is mobile or stationary. This provides the serverwith temporal and spatial data pertaining to the environmental variableswhich follow.

In step 206 the server (in other embodiments, analysis can be carriedout by one or more of the networked pervasive devices in addition to orin lieu of the central server) analyzes the data within geographic areaslabeled X and Y and, based upon environmental models, can determine theprobability an event is occurring in real time within the X and/or Ygeographic area which is referred to as P (A, X) or P (A, Y). In step208 the probability is compared to a threshold, which in this case ischosen to be, for exemplary purposes and not limitation, 0.7 or 70%, andif it exceeds that threshold within one of the geographic regions theserver may send a notification to, for example, the users of thepervasive devices within the affected region and emergency responseunits. For example, an earthquake event can be detected by recording thereal time shock data of devices within a geographic area or a chemicalspill can be detected by changes in chemical composition. Analysis canbe performed, for example, using artificial intelligence and/or patternrecognition techniques.

In step 210 the server determines if the event in region X will affectusers in a neighboring region Y by calculating the probability that theevent in one region would affect the other. For example, upondetermining by means of chemical sensors that a gaseous discharge hasoccurred in region X, the server could analyze wind direction (obtainedusing wind direction sensors) to see whether region Y will be affectedas well. Notification of individuals (including but not limited to usersof one or more of the pervasive devices) or authorities (such asemergency responders) in a currently affected region, and/or a regionlikely to be affected in the future, is conducted in step 212. Past orreal-time events can be detected, and future events can be predicted. Ina subscription model, subscribers can be informed of detected orpredicted events.

Turning now to FIG. 3, an exemplary networked pervasive device 300associated with a network includes at least one environmental sensor 308configured to obtain environmental data, and a communications module 306coupled to the at least one environmental sensor and configured to causetransmission of a representation of the data via the network in a formfor subsequent data mining within the network. In the example of FIG. 3,the device is a wireless device, and includes an antenna 302, transmitcircuitry 304 coupled to the antenna 302 for transmission of radiofrequency radiation therefrom, and the aforementioned environmentalsensor 308 configured to obtain environmental data from environment 310.Further, device 300 includes the aforementioned communications module306 coupled to the at least one environmental sensor 308 (and in theexample, to circuitry 304) and configured to cause transmission of arepresentation of the data via the antenna 302 and the transmitcircuitry 304.

In one aspect device 300 comprises a cellular telephone. Further,receive circuitry can be provided, coupled to the antenna 302 and thecommunications module 306. In the example of FIG. 3, the transmit andreceive circuitry is shown as combined transmit/receive circuitry,referred to as element 304, but other approaches are possible. Thetransmission can be responsive to a polling signal received by thereceive circuitry 304, or can be responsive to a signal generatedlocally by the communications module 306. Communication with the networkcan be, for example, via a cellular tower with base station 312,coupled, for example, to a central server 314 (or processing in anetwork of pervasive devices could be employed instead of the centralserver). While the exemplary pervasive device is shown in wireless form,one or more embodiments of the invention may employ one or morehard-wired pervasive devices, in addition to, or in lieu of, wirelessdevices.

Turning now to FIG. 4, a more specific example of a wireless pervasivedevice 400 is in the form of a personal digital assistant (PDA) 402 withenhanced sensing capabilities. A dual axis accelerometer 404 and atemperature sensor 406 can be mounted on a chip carrier 408, forming asensor-system-on-package, which can be mounted on a circuit board 410 ofPDA 402 FIG. 4 thus shows an example of embedding sensors into apervasive computing device. By way of example and not limitation, thesensors 404, 406 could be micro electro-mechanical systems (MEMS)technology environmental sensors, integrated onto silicon. Suitabletemperature sensors and accelerometers are made by Analog Devices, Inc.,of Norwood, Mass., USA, model numbers ADIS16003 (accelerometer) andAD590 (temperature sensor). These devices can be integrated onto a chipcarrier 408 to produce a very high density system on package forincorporation into the device 402.

It should be understood that the real time identification of events canbe used in several ways. Systems can use this information to takeautonomic actions; for example, to protect data and/or power downbuilding systems. The data could be used to send instructions to usersto take specific appropriate actions, such as to don gas masks and/orevacuate buildings. Emergency systems can be controlled remotely toassist in mitigation or resources in neighboring locations can benotified to take preemptive action.

Many different types of data can be sensed; for example, location(including elevation) via a global positioning system (GPS); cameraimages, heat, radiation, infra-red radiation (for example, to detectlocation of humans in environments that are supposed to be empty), soot,abnormal numbers of phone calls, pressure or other indications ofthunderstorms, tornadoes, and the like, temperature, and the like. Asnoted, artificial intelligence or pattern recognition can be employed todetermine what is normal and perform appropriate classification anddetection. Protection may be afforded against terrorist acts, severeweather, fires, accidents, or even traffic conditions and the like. Dataof many disparate types and from many disparate sources can be readilyfused, for example, wind conditions, wave heights, air temperature,humidity, traffic or other road or transportation conditions, and in oneor more embodiments, can be compared to a baseline. Other possibleapplications include battlefield management, integration with stolen carlocators such as LOJACK® transponder units (LOJACK® is a registeredtrademark of Lojack Corporation, Westwood, Mass., USA, and the like.Disparate data may be fused and yield a simple, high-levelrecommendation. For example, suppose there a problem at a nuclear powerplant. Wind and radiation sensors might determine and/or predict thearea to be affected by a radiation plume. Traffic sensors mightdetermine a best, least congested route, in the opposite direction fromthe plume, and yield a simple recommendation, such as “Drive north onState Route 9” or simply “Run north.”

In another aspect, a service, such as a subscription service, can beoffered. With reference to FIG. 5, a flow chart 500 of exemplary methodsteps for providing a service for monitoring environmental conditions isdepicted therein. After beginning at block 502, step 504 includesfacilitating offering the monitoring service on a subscription basis.Step 506 includes facilitating receiving subscriptions to the servicefrom a plurality of subscribers. Step 508 includes facilitatingacquisition of data pertaining to environmental information using atleast one sensor on at least one networked pervasive device, asdescribed above. Step 510 includes facilitating analysis of the data todetermine occurrence of at least one environmental event, as describedabove. Step 512 includes facilitating notification of at least one ofthe subscribers of the occurrence of the event. Processing continues atblock 514. One or more steps can be computer-implemented. Such stepscould be performed, for example, by an entity that hosted data andperformed integration, working in conjunction with, for example, aninternet service provider and a cellular telephone company.

A variety of techniques, utilizing dedicated hardware, general purposeprocessors, firmware, software, or a combination of the foregoing may beemployed to implement the present invention. One or more embodiments ofthe invention can be implemented in the form of a computer productincluding a computer usable medium with computer usable program code forperforming the method steps indicated. Furthermore, one or moreembodiments of the invention can be implemented in the form of anapparatus including a memory and at least one procession that is coupledto the memory and operative to perform exemplary method steps.

At present, it is believed that one or more embodiments will makesubstantial use of software running on a general purpose computer orworkstation. With reference to FIG. 6, such an implementation mightemploy, for example, a processor 602, a memory 604, and an input/outputinterface formed, for example, by a display 606 and a keyboard 608. Theterm “processor” as used herein is intended to include any processingdevice, such as, for example, one that includes a CPU (centralprocessing unit) and/or other forms of processing circuitry. Further,the term “processor” may refer to more than one individual processor.The term “memory” is intended to include memory associated with aprocessor or CPU, such as, for example, RAM (random access memory), ROM(read only memory), a fixed memory device (e.g., hard drive), aremovable memory device (e.g., diskette), a flash memory and the like.In addition, the phrase “input/output interface” as used herein, isintended to include, for example, one or more mechanisms for inputtingdata to the processing unit (e.g., mouse), and one or more mechanismsfor providing results associated with the processing unit (e.g.,printer). The processor 602, memory 604, and input/output interface suchas display 606 and keyboard 608 can be interconnected, for example, viabus 610 as part of a data processing unit 612. Suitableinterconnections, for example via bus 610, can also be provided to anetwork interface 614, such as a network card, which can be provided tointerface with a computer network, and to a media interface 616, such asa diskette or CD-ROM drive, which can be provided to interface withmedia 618.

Accordingly, computer software including instructions or code forperforming the methodologies of the invention, as described herein, maybe stored in one or more of the associated memory devices (e.g., ROM,fixed or removable memory) and, when ready to be utilized, loaded inpart or in whole (e.g., into RAM) and executed by a CPU. Such softwarecould include, but is not limited to, firmware, resident software,microcode, and the like.

Furthermore, the invention can take the form of a computer programproduct accessible from a computer-usable or computer-readable medium(e.g., media 618) providing program code for use by or in connectionwith a computer or any instruction execution system. For the purposes ofthis description, a computer usable or computer readable medium can beany apparatus for use by or in connection with the instruction executionsystem, apparatus, or device.

The medium can be an electronic, magnetic, optical, electromagnetic,infrared, or semiconductor system (or apparatus or device) or apropagation medium. Examples of a computer-readable medium include asemiconductor or solid-state memory (e.g. memory 604), magnetic tape, aremovable computer diskette (e.g. media 618), a random access memory(RAM), a read-only memory (ROM), a rigid magnetic disk and an opticaldisk. Current examples of optical disks include compact disk-read onlymemory (CD-ROM), compact disk-read/write (CD-R/W) and DVD.

A data processing system suitable for storing and/or executing programcode will include at least one processor 602 coupled directly orindirectly to memory elements 604 through a system bus 610. The memoryelements can include local memory employed during actual execution ofthe program code, bulk storage, and cache memories which providetemporary storage of at least some program code in order to reduce thenumber of times code must be retrieved from bulk storage duringexecution.

Input/output or I/O devices (including but not limited to keyboards 608,displays 606, pointing devices, and the like) can be coupled to thesystem either directly (such as via bus 610) or through intervening I/Ocontrollers (omitted for clarity).

Network adapters such as network interface 614 may also be coupled tothe system to enable the data processing system to become coupled toother data processing systems or remote printers or storage devicesthrough intervening private or public networks. Modems, cable modem andEthernet cards are just a few of the currently available types ofnetwork adapters.

In any case, it should be understood that the components illustratedherein may be implemented in various forms of hardware, software, orcombinations thereof e.g., application specific integrated circuit(s)(ASICS), functional circuitry, one or mole appropriately programmedgeneral purpose digital computers with associated memory, and the like.Given the teachings of the invention provided herein, one of ordinaryskill in the related art will be able to contemplate otherimplementations of the components of the invention.

Although illustrative embodiments of the present invention have beendescribed herein with reference to the accompanying drawings, it is tobe understood that the invention is not limited to those preciseembodiments, and that various other changes and modifications may bemade by one skilled in the art without departing from the scope orspirit of the invention.

1. A method of monitoring environmental conditions, comprising the stepsof: acquiring data pertaining to environmental information using amultiplicity of sensors on a multiplicity of networked pervasivedevices; and analyzing said data to determine occurrence of at least oneenvironmental event.
 2. The method of claim 1, wherein said acquiringstep comprises substantially continuous monitoring by said multiplicityof networked pervasive devices to obtain said data.
 3. The method ofclaim 1, wherein said acquiring step further comprises acquiringindications regarding geographic coordinates at which at least some ofsaid data was acquired.
 4. The method of claim 1, wherein said acquiringstep further comprises acquiring indications regarding a time at whichat least some of said data was acquired.
 5. The method of claim 1,wherein said analyzing step is performed by a centralized server whichobtains said data from said multiplicity of networked pervasive devices.6. The method of claim 1, wherein said analyzing step is performed by atleast one of said multiplicity of networked pervasive devices.
 7. Themethod of claim 1, wherein said analyzing step comprises determining astatistical probability of occurrence of said at least one environmentalevent.
 8. The method of claim 1, wherein said analyzing step comprisesat least one of artificial intelligence and pattern recognition.
 9. Themethod of claim 1, wherein said at least one environmental event hasoccurred in a past time, and wherein said analyzing step comprisesdetermining past occurrence of said at least one environmental event.10. The method of claim 1, wherein said at least one environmental eventis occurring in real time, and wherein said analyzing step comprisesdetermining real-time occurrence of said at least one environmentalevent.
 11. The method of claim 1, wherein said at least oneenvironmental event is likely to occur in a future time, and whereinsaid analyzing step comprises predicting future occurrence of said atleast one environmental event.
 12. The method of claim 1, furthercomprising the additional step of providing notification of saidenvironmental event.
 13. The method of claim 12 wherein saidnotification is provided to at least one user of at least one of saidmultiplicity of networked pervasive devices.
 14. The method of claim 12wherein said notification is provided to at least one individualsituated within one of: a geographic region in which said environmentalevent is determined to be currently occurring; and a geographic regionwhich may be subsequently affected by said environmental event.
 15. Themethod of claim 12 wherein said notification is provided to at least oneemergency responder.
 16. The method of claim 12 wherein saidnotification is provided to at least one subscribe.
 17. An article ofmanufacture for monitoring environmental conditions, comprising amachine readable medium containing one or more programs which whenexecuted implement the steps of: acquiring data pertaining toenvironmental information using at least one sensor on at least onenetworked pervasive device; and analyzing said data to determineoccurrence of at least one environmental event.
 18. A networkedpervasive device associated with a network, said device comprising: atleast one environmental sensor configured to obtain environmental data;and a communications module coupled to said at least one environmentalsensor and configured to cause transmission of a representation of saiddata via said network in a from for subsequent data mining within saidnetwork.
 19. The device of claim 18, wherein said device comprises awireless communications device, further comprising: an antenna; andtransmit circuitry coupled to said antenna for transmission of radiofrequency radiation therefrom; wherein said representation of said datais transmitted through said network via said antenna and said transmitcircuitry.
 20. The device of claim 19, wherein said device comprises acellular telephone, further comprising receive circuitry coupled to saidantenna and said communications module, wherein said transmission isresponsive to a polling signal received by said receive circuitry. 21.The device of claim 19, wherein said transmission is responsive to asignal generated locally by said communications module.
 22. A method ofproviding a service for monitoring environmental conditions, comprisingthe steps of: facilitating offering said monitoring service on asubscription basis; facilitating receiving subscriptions to said servicefrom a plurality of subscriber's; facilitating acquisition of datapertaining to environmental information using at least one sensor on atleast one networked pervasive device; facilitating analysis of said datato determine occurrence of at least one environmental event;facilitating notification of at least one of said subscribers of saidoccurrence of said event.